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1.0  SUMMARY 

This  report  describes  the  methods,  procedures  and  results  of  developing  software  infrastructure  for 
allowing  remote  control  of  a  bipedal  human-scale  Atlas  robot.  This  work  focuses  on  allowing  remote 
operations  in  severely  communications  restricted  environments  for  search  and  rescue.  The  research 
relied  heavily  on  abstraction  methods  for  issuing  commands,  compression  and  processing  of  sensor 
data,  and  ensuring  the  safety  of  the  robot  during  execution.  The  DARPA  Robotics  Challenge  provided  a 
live  demonstration  to  showcase  the  robots  performance  in  a  simulated  search  and  rescue  environment. 

The  abstraction  techniques  developed  from  both  a  control  and  terrain  estimation  viewpoint,  were 
successfully  able  to  allow  autonomous  operation.  These  techniques  substantially  reduced  the  amount 
of  communication  necessary  between  the  human  operator  and  the  robot  allowing  them  to  operate  with 
substantial  delays  in  communication  as  well  as  complete  losses  of  communication. 

The  software  developed  was  successfully  able  to  control  the  robot  to  complete  a  significant  majority  of 
tasks  to  drive  a  vehicle,  dismount  the  vehicle,  open  a  door,  manipulate  various  objects  and  ultimately 
walk  through  uneven  surfaces  and  climb  stairs.  MIT  placed  sixth  in  the  finals  which  was  an  impressive 
finish  given  that  their  best  run  required  them  to  operate  without  the  use  of  one  arm  which  was 
damaged  in  a  fall. 


2.0  INTRODUCTION 

Fueled  by  a  sense  of  urgency  and  purpose  provided  by  the  DARPA  Robotics  Challenge  (DRC),  over  the 
course  of  this  program  MIT  has  made  dramatic  progress  in  remote-assisted  dexterous  manipulation  (and 
legged  locomotion).  Their  work  earned  them  a  fourth  place  finish  in  the  2013  DRC  Trials,  and  a  sixth 
place  finish  in  the  2015  DRC  Finals.  Those  numbers  only  tell  a  part  of  the  story.  Beyond  providing 
robust  implementations  of  known  best  algorithms,  the  team  consistently  pushed  the  frontiers  of 
research.  Our  system  was  widely  considered  one  of  the  most  autonomous  of  the  capabilities,  and  the 
research  papers  published  about  the  technology  have  won  Best  Paper  awards  (or  Best  Paper  Finalist)  at 
the  annual  Flumanoid  Robotics  Conference  every  year  since  they  began  publishing  in  the  domain. 

The  research  developed  novel  algorithms,  and  also  provided  a  detailed  post-mortem  analysis  of  the 
performance  in  the  competitions.  Moreover,  throughout  the  duration  of  the  program,  the  performers 
have  continued  to  push  nearly  all  of  the  developed  code  to  open-source  on  github.com,  have  used  these 
in  a  robotics  MOOC  (massive  open  online  course),  and  continue  to  support  the  growing  community  of 
users.  At  the  DRC  Finals,  DARPA  recognized  the  team  with  the  Seth  Teller  Memorial  Award  for 
Contributions  to  Open-Source  Software. 

The  following  pages  provide  a  high-level  summary  of  the  advances,  with  pointers  to  research  papers  and 
reports  with  the  specific  algorithmic  details. 
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3.0  METHODS,  ASSUMPTIONS,  AND  PROCEDURES 


3.1  TERRAIN  PERCEPTION 


In  the  DRC  finals,  they  fielded  a  terrain  perception  system  that  made  primary  use  of  LIDAR.  They 
produced  a  general-purpose  height  map  estimation  functionality  which  allows  the  robot  to  walk  on 
arbitrary  terrain.  Additionally,  the  research  introduced  specialized  perception  algorithms  for  fitting 
terrain  primitives  —  especially  cinder  blocks  and  stairs.  In  addition  to  single  primitives,  composite 
groups  of  geometry  are  also  supported.  These  groupings  can  be  used  both  to  support  the  stairs  use  case 
as  well  as  various  configurations  of  stacked  and  tilted  cinder  blocks  as  seen  in  the  DRC. 


^  segmented 
^planar  regions 
with  estimated 
surface  extents 


Figure  1  -  An  overview  of  the  transformation  from  images  to  point  clouds  and  surfaces 


Since  the  geometric  primitives  are  aligned  using  noisy  sensor  data,  a  method  to  continually  adjust  and 
reevaluate  their  position  and  orientation  was  implemented.  This  ensures  that  as  progress  is  made 
across  the  terrain,  new  information  is  incorporated  to  maintain  the  accuracy  of  the  perceived  map. 

When  combined  with  robust  online  replanning  of  footsteps,  this  enabled  the  performer  to  achieve  a 
very  high  success  rate  in  our  attempts  to  traverse  uneven  terrain  environments  with  the  Atlas  bipedal 
robot. 

The  LIDAR  provided  clean  and  high-resolution  data  even  outdoors,  but  at  a  very  low  rate  (this  was  the 
primary  reason  why  our  robots  moved  slowly  during  the  competition).  Our  algorithms  would  wait  for  an 
entire  revolution  of  the  LIDAR  before  attempting  to  walk,  and  they  opted  to  spin  the  laser  relatively 
slowly  in  order  to  obtain  a  dense  point  cloud.  In  the  lab,  the  team  demonstrated  a  much  more 
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aggressive  approach  based  solely  on  stereo  vision  [12],  which  enabled  continuous  walking  over  the  same 
terrain. 

MIT  additionally  developed  an  approach  for  humanoid  robots  to  perform  mobility  reliably  and  efficiently 
over  rugged  irregular  terrain.  They  researched  a  method  for  a  robot  to  utilize  only  passive  stereo 
imagery  to  plan  footsteps  to  continuously  walk  over  challenging  terrain.  The  stereoscopic  cameras  were 
capable  of  building  a  three  dimensional  model  of  the  terrain.  This  three  dimensional  model  was  met 
with  a  quadratic  optimization  plan  which  developed  an  optimal  plan  over  step  positions  allowing 
continuous  motion  while  minimizing  latency. 

The  stereoscopic  imagery  was  not  used  in  the  Finals  due  to  the  inability  to  test  the  algorithm  under 
sufficiently  varied  (outdoor)  lighting  conditions. 

3.2  WHOLE-BODY  STATE  ESTIMATION 

The  whole  body  state  estimator  Pronto  [7]  was  developed  by  building  upon  an  existing  state  estimator 
developed  by  MIT  that  has  been  proven  on  unmanned  aerial  vehicles  (UAVs).  The  underlying  algorithm 
is  based  on  an  Extended  Kalman  Filter  (EKF)  that  simultaneously  estimates  robot  state  and  sensor 
biases. 

The  filter  developed  provided  a  probabilistic  fusion  of  sensor  data  from  many  modalities  to  produce  a 
single  consistent  position  estimation  for  a  walking  humanoid.  Given  a  prior  map  using  a  Gaussian 
particle  filter,  the  LIDAR  based  system  is  able  to  provide  a  drift-free  alignment  resulting  in  reliable 
localization  of  the  robot. 

The  module  can  also  be  bootstrapped  to  providing  an  on-the-fly  map  of  the  system  and  is  capable  of 
performing  very  robustly  in  challenging  field  situations.  Additionally,  their  estimation  hierarchy  utilizes  a 
two-tier  infrastructure  allowing  both  low  level  control  of  the  robot  while  preserving  registration  of  the 
robot  and  objects  in  the  robots  vicinity. 

In  addition  to  the  information  provided  by  the  Inertial  Measurement  Unit  (IMU),  Pronto  is  able  to  fuse 
data  from  a  variety  of  sensors  that  are  commonly  found  on  bipedal  robots.  This  includes  laser  range 
finders,  stereo  cameras,  joint  encoders,  and  force-torque  contact  sensors.  Moreover,  the  state 
estimator  has  been  extended  to  leverage  insights  into  the  nature  of  contact  to  provide  estimates  that 
surpass  the  accuracy  of  uninformed  methods.  An  example  of  this  is  knowledge  of  when  the  robot's  foot 
is  in  contact  with  the  ground  and  exploiting  that  information  by  constraining  the  kinematic  pose  being 
estimated. 

The  research  has  continued  to  develop  the  state  estimator  using  a  simple  dynamic  model  and  a 
complete  kinematic  model  (including  the  effects  of  torque-deflection,  etc)  following  the  approach  in  the 
paper  on  "Drift-free  state  estimation"[7].  The  algorithm  has  been  optimized  to  run  at  rates  that  exceed 
333  Hz  on  commodity  hardware  to  ensure  that  reliable  estimates  are  available  at  rates  that  enable  fast 
and  dynamic  responses. 
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3.3  FOOTSTEP  PLANNING 

Research  on  explicitly  addressing  the  combinatorial  aspects  of  footstep  planning  by  formulating  mixed- 
integer  convex  optimization  has  been  one  of  the  most-cited  results  from  this  effort  [8],  The  team  has 
continued  to  refine  and  optimize  the  speed  of  this  algorithm,  getting  it  now  to  the  point  where  it  is  fast 
enough  to  support  dynamic  step  recovery.  If  unexpected  disturbances  or  conditions  would  cause  the 
robot  to  fall,  a  reactive  step  recovery  algorithm  has  been  implemented  based  on  the  concept  of  the 
Instantaneous  Capture  Point  (ICP).  The  ICP  is  continually  evaluated  so  that  if  a  fall  is  about  to  occur,  a 
stabilizing  foothold  is  available  at  all  times.  This  allows  the  robot  to  switch  to  a  recovery  plan  that 
quickly  places  a  foot  at  the  ICP  to  regain  stability  from  a  situation  that  would  otherwise  result  in  a  loss  of 
balance.  The  image  below  shows  the  robot  reacting  to  being  pushed  over  by  placing  its  right  foot 
behind  itself  to  catch  its  fall. 


Figure  2  -  Demonstration  of  the  robot's  dynamic  balancing 


Although  such  dynamic  footstep  plans  were  demonstrated  during  the  DRC  finals  where  the  robot  was 
able  to  save  itself  from  a  fall  during  the  uneven  terrain  task,  this  is  a  relatively  new  advancement  and 
there  is  still  much  work  to  be  done  in  this  area.  Some  of  the  possibilities  include  adding  additional 
constraints  to  the  stabilizing  footholds  to  account  for  known  structure  in  the  terrain  and  using  other 
parts  of  the  robot  such  as  hands  and  elbows  to  aid  in  recovery. 

The  team  continues  pushing  in  research  in  this  direction.  In  addition,  they  worked  through  versions  of 
this  planner  that  support  quadruped  models  and  aerial  phases  where  a  primary  challenge  is  finding  a 
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suitable  convex  relaxation  for  angular  momentum.  Significant  progress  in  this  direction  was  reported  in 

[21]. 


This  research  primarily  focused  on  dynamic  potion  planning  for  legged  robots  specifically  in  terms  of 
joint  movement.  This  research  focused  on  planning  which  limb  should  touch  a  surface,  which  order  this 
should  happen  in  and  how  much  force  should  be  applied  when  impacting  the  surface.  The  research 
leveraged  centroidal  dynamics  to  determine  the  joint  angle  trajectories  in  terms  of  placement. 
Optimization  was  performed  through  a  mixed  integer  quadratic  program.  This  program  took  into 
account  center  of  mass  as  well  as  angular  momentum  trajectories.  The  research  resulted  in  novel 
approaches  for  bipedal  gait  selection  over  irregular  terrain,  trajectory  optimization  formulation  for 
floating-base  systems,  and  a  planning  methodology  integrating  extremely  dynamic  motions  in  a  diverse 
live  environment. 

3.4  WHOLE-BODY  DYNAMIC  MOTION  PLANNING 

Where  previously  the  connection  between  the  footstep  planner  and  whole-body  motion  planner  was 
relatively  simple  (involving  only  footstep  regions),  the  footstep  planner  extensions  described  above 
mean  that  it  is  solving  more  and  more  of  (a  convex  approximation  of)  the  full  body  motion  planning 
problem.  Considerable  effort  was  devoted  towards  exploring  this  boundary  and  highly  dynamic  whole- 
body  plans  were  found  more  efficiently  and  more  reliably  given  a  two-step  approach  [20,22], 

A  recent  discovery  made  by  members  of  the  research  team  revealed  that  there  is  a  closed  form  solution 
for  the  optimal  controller  for  stabilizing  Zero-Moment  Point  (ZMP)  trajectories.  A  highly  optimized 
version  of  this  algorithm  has  been  implemented  in  Drake.  Using  this  technique,  solving  for  optimal  ZMP 
stabilizing  controllers  can  be  performed  in  sub-millisecond  computation  time  [11], 

Since  this  can  now  be  performed  in  real-time,  continuous  re-evaluation  of  the  walking  controller  allows 
deviations  in  the  planned  footsteps  to  be  corrected  for  by  always  using  the  most  recently  computed 
gait.  This  not  only  alleviates  errors  that  would  otherwise  accumulate  as  the  plan  is  executed,  but  also 
increases  stability  and  robustness  to  the  point  where  the  robot  is  able  to  successfully  complete  walking 
tasks  where  footstep  tracking  is  intentionally  degraded  by  up  to  a  factor  of  10.  Prior  to  the 
implementation  of  this  algorithm,  such  a  tracking  error  would  cause  the  robot  to  immediately  fall. 


Foot»lc]B  ZMP 

Planned  |  I  - — 

Estimated  |  | 


Figure  3  -  Bipedal  multi-dimensional  motion  estimation  planning 
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The  image  above  shows  footstep  tracking  performance  during  real-time  recomputation  of  the  walking 
plan.  Although  the  tracking  performance  was  intentionally  degraded  by  an  order  of  magnitude,  the  final 
position  is  still  reached  by  continuously  recomputing  the  controller  online. 


3.5  WHOLE-BODY  FEEDBACK  CONTROL 


The  execution  speed  of  the  controller  is  critical  in  enabling 
dynamic  and  reactive  behavior.  Moreover,  since  the  controller  is 
now  able  to  run  at  rates  that  far  exceed  the  natural  timescale  of 
the  underlying  mechanical  system,  it  can  make  small  adjustments 
that  allow  for  delicate  balancing  tasks.  The  image  on  the  right 
shows  the  robot  demonstrating  this  in  a  task  that  involves 
balancing  on  one  foot.  A  slower  controller  would  have  a  difficult 
time  producing  the  fine-grained  corrections  quickly  enough  to 
maintain  balance  in  this  situation  likely  resulting  in  a  fall  or 
significant  loss  of  balance. 


One  of  the  early  results  of  this  program  was  the  development  of  an  optimization-based  feedback  control 
approach  that  continued  to  perform  well  for  complex  control  tasks  on  a  humanoid  throughout  the 
competition  [2],  By  the  end  of  the  program,  code  was  significantly  optimized.  This  resulted  in  a  control 


rate  up  to  nearly  1  kHz  by  separating  the  "plan  evaluation"  into  a 
separate  process  from  the  main  quadratic-program-based 
controller.  This  gave  a  significant  performance  increase  in  terms 
of  robustness,  and  dramatically  reduced  (essentially  eliminated) 
the  number  of  times  that  our  "Fast-QP"  algorithm  had  to  fall  back 
on  the  commercial  QP  solver. 


Figure  4  -  Balance  feedback  demonstration  of  the 
Atlas  robot 


The  current  formulation  is  carefully  integrated  with  "ZMP-style"  walking  algorithms  for  gait  planning  on 
flat  terrain  with  a  nearly  constant  center  of  mass  height.  Current  experiments  focus  now  on  stabilizing 
the  more  diverse  plans  that  come  out  of  the  whole-body  planning  code,  and  testing  them  on  the  real 
robot. 


Recently,  the  QP  controller  developed  for  the  Atlas  robot  has  been  applied  to  the  control  of  the  Boston 
Dynamics  Little  Dog  quadruped  robot.  This  work  has  shown  that  the  control  concepts  and  optimizations 
developed  for  Atlas  can  easily  be  extended  to  the  quadruped  domain. 


3.6  MANIPULATIONS 

Although  it  was  anticipated  that  dexterous  manipulation  would  be  a  major  focus  of  research  over  the 
duration  of  the  program,  a  number  of  reasons  changed  this  focus.  First  and  foremost,  the  original  robot 
hands  that  were  capable  of  dexterous  manipulation  turned  out  to  be  too  fragile  to  be  used  reliably  in 
competition.  Instead,  the  team  and  most  of  other  teams  elected  to  use  the  three-fingered  gripped  from 
Robotiq  -  effectively  a  large  but  robust  robot  claw.  As  a  consequence,  DARPA  reduced  the  scope  and 
complexity  of  the  manipulation  tasks. 

One  area  that  did  require  considerable  research  attention  was  perception  for  manipulation,  and  the 
low-latency  remote  operation  of  the  manipulation  system.  They  developed  a  graphical  user  interface, 
Director,  which  not  only  served  as  the  tool  for  piloting  our  robot,  but  also  as  a  tool  for  rapidly 
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prototyping  perception  algorithms  [17].  Written  in  python  and  VTK,  it  provided  hugely  valuable  libraries 
for  writing  algorithms  for  and  visualizing  point  cloud  data. 


Figure  5  -  User  view  of  Atlas  robots  procedural  manipulation  planning 


By  the  end,  the  robot  was  mostly  autonomous,  except  during  the  surprise  task.  The  robot  had  a  simple 
state  machine  for  the  task-level  planning.  The  human  pilot(s)  would  provide  a  few  clicks  in  order  to  seed 
otherwise  autonomous  perception  algorithms,  and  then  would  watch  the  state  machine  execute.  The 
user  interface  showed  the  trajectories  that  the  robot  was  about  to  execute  before  it  actually  executed 
them,  allowing  the  operator  to  prevent  any  motion  that  could  have  had  unintended  consequences. 
Otherwise  the  robot  was  operating  almost  entirely  on  its  own. 


4.0  RESULTS  AND  DISCUSSION 
4.1  DRC  FINALS  COMPETITION 

The  research  results  summarized  above  were  all  choreographed  in  a  complex  dance  that  balanced 
research  vs  competition-readiness.  The  unfortunate  truth  was  that  the  competition  rewarded  very 
simple  robot  strategies  that  were  extensively  tested/debugged  experimentally.  The  performer  had  to 
balance  pushing  forward  new  capabilities  with  fielding  limited  capabilities  robustly.  Most  teams  chose 
the  more  conservative  approach,  the  rules  changes  to  accommodate  the  weaker  technology  right  up 
until  the  end. 
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MIT's  performance  in  the  competition  was  adequate.  They  put  themselves  in  a  position  to  win,  with  an 
advanced  set  of  capabilities  based  on  autonomy  that  could  have  allowed  our  robot  to  address  the 
harder  versions  of  the  competition  rules.  This  was  showcased  somewhat  during  the  DRC  Finals,  after 
our  robot  fell  and  broke  its  right  arm.  Most  testing  was  performed  using  only  the  right  arm,  and  the 
performers  had  planned  to  use  it  almost  exclusively  for  all  of  the  manipulation  tasks.  After  the  damage 
during  the  start  of  the  run,  the  performers  were  able  to  flip  a  bit  in  the  software,  and  watch  as  our  robot 
very  seemlessly  adapted  to  using  the  left  arm  for  all  the  remaining  tasks.  The  drill  task  unfortunately 
required  two  hand  to  operate.  This  change  rippled  through  the  system  in  many  subtle  ways.  An 
interesting  observation  of  this  was  the  robot's  decision  to  approach  the  valve  task  from  the  right  side. 
This  was  due  to  the  fact  that  the  robot  knew  it  would  need  to  have  room  to  allow  the  left  hand  space  to 
manipulate  the  valve.  This  dynamic  reasoning  was  significant  as  during  the  practice  runs  it  had  always 
approached  the  task  from  the  opposite  side  when  the  right  hand  was  functioning  properly. 


Detailed  summaries  of  our  performance  during  the  trials  are  available  in  [1],  and  during  the  finals  are 
available  in  [17]. 


Figure  6  -  MIT's  Atlas  Robot  performing  driving  task  at  DRC  Finals 


The  driving  task  consisted  of  the  robot  driving  a  heavily  modified  Polaris  Ranger  through  a  set  of  Jersey 
barriers  past  a  finish  line.  This  required  the  robot  grasping  and  manipulating  a  steering  wheel  while 
controlling  a  gas  pedal  using  its  foot.  The  gearing  of  the  Ranger  allowed  the  vehicle  to  come  to  a  stop 
without  the  need  to  apply  pressure  to  a  brake  pedal.  Additionally,  the  robot  needed  an  additional 
mount  to  allow  it  to  easily  dismount  the  vehicle  upon  completion.  Figure  6  shows  the  robot  completing 
the  driving  task  at  the  DRC  finals. 
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Figure  7  -  MIT's  Atlas  robot  failing  to  successfully  dismount  the  Polaris  Ranger. 

During  one  of  MIT's  runs,  dismounting  the  vehicle  was  not  successful.  The  fall  resulting  in  moderate 
damage  to  the  robot  particularly  incapacitating  the  robot's  right  arm.  The  robot  was  however  able  to 
accommodate  for  the  damaged  limb  and  continue  accomplishing  tasks  using  the  opposite  arm. 


Figure  8  -  Atlas  Robot  successfully  opening  a  door  and  crossing  the  threshold. 
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The  task  of  opening  a  door  relied  heavily  on  abstraction  of  plans  and  conveyance  of  abstracted  surfaces 
and  point  clouds.  The  task  also  relied  on  the  robot  applying  only  enough  force  to  open  the  door  and  not 
too  much  force  as  to  send  the  door  flying  back  into  the  robots  face.  The  MIT  team  was  able  to  complete 
this  task  and  cross  the  threshold  as  shown  in  figure  8. 


Figure  9  -  A  remote  view  of  the  valve  task  as  seen  by  the  human  operator  at  base  station 


One  of  the  more  difficult  manipulation  tasks  required  the  robot  to  turn  a  valve.  The  valve  task  required 
substantial  surface  abstraction  given  the  valve  shape  and  the  granularity  of  the  point  cloud.  This  type  of 
surface  was  similar  to  the  steering  wheel  in  the  driving  task.  Unlike  the  driving  task,  however,  the  robot 
had  to  manually  grasp  the  shape  without  prior  operator  placement.  MIT  was  successfully  able  to 
accomplish  the  task  of  grasping  and  turning  the  valve. 
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Figure  10  -  Traversal  of  the  uneven  terrain  at  the  DRC  finals 


Navigating  uneven  terrain  was  an  extremely  perilous  task  for  the  Atlas  robots.  Unlike  some  other 
entries,  the  Atlas  is  not  equipped  to  lower  its  center  of  gravity  enough  to  minimize  balancing  issues. 
Instead,  careful  planning  and  execution  must  be  performed.  MIT  was  one  of  the  few  teams  choosing  to 
perform  this  task  over  the  alternative  of  removing  debris.  The  MIT  team's  research  developed  over  the 
course  of  the  program  allowed  the  robot  to  successfully  traverse  the  terrain  with  no  falls. 

Finally,  the  robot  was  required  to  complete  another  balance  task  of  climbing  a  set  of  stairs.  Negotiating 
this  obstacle  required  substantial  balance  and  planning  to  allow  the  robot  to  maintain  its  balance 
through  careful  monitoring  and  adjustment  of  its  center  of  gravity.  The  MIT  team  was  able  to  complete 
this  task  and  was  awarded  full  points  for  its  completion. 
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Figure  11  -  The  robot  successfully  traversing  the  stairs  obstacle 


5.0  CONCLUSIONS 

Massachusetts  Institute  of  Technology's  team  developed  novel  technologies  capable  of  significantly 
advancing  the  state-of-the-art  in  bipedal  navigation  in  dynamic  communications  degraded 
environments.  Their  teams  mediocre  finish  should  not  undermine  the  significant  advanced  made  in  the 
fields  of  bipedal  locomotion,  stereoscopic  visual  estimation,  state-estimation  and  planning.  The 
substantial  impacts  of  their  research  will  continue  to  revolutionize  the  field  of  robotics  for  years  to 
come.  The  performers  published  substantial  volumes  in  the  form  of  peer-reviewed  conference  and 
journal  publications  and  additionally  dissertations  and  theses  on  the  research  areas  were  published. 
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LIST  OF  SYMBOLS,  ABBREVIATIONS,  AND  ACRONYMS 


DARPA 

Defense  Advanced  Research  Projects  Agency 

DRC 

DARPA  Robotics  Challenge 

ICP 

Instantaneous  Capture  Point 

IMU 

Inertial  Measurement  Unit 

LIDAR 

Light  Detection  and  Ranging 

MIT 

Massachusetts  Institute  of  Technology 

QP 

Quadratic  Program 

VTK 

Video  Toolkit 

ZMP 

Zero  Moment  Point 
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